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Abstract 

In this article, a class of optimal control problems of differential equations with delays are 
investigated for which the associated Hamilton-Jacobi-Bellman (HJB) equations are nonlinear 
partial differential equations with delays. This type of HJB equation has not been previously 
studied and is difficult to solve because the state equations do not possess smoothing properties. 
We introduce a slightly different notion of viscosity solutions and identify the value function of 
the optimal control problems as a unique viscosity solution to the associated HJB equations. 
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1 Introduction 

In this paper, we consider the following controlled differential equations with delays: 

j dX u (s ) = F(s, X u (s), (a, X%) H ,u(s))ds + b(s)X u (s - r)ds, s £ [t, T], 

\ X? = x € V, 

where 

X?(e) = X»(s + e), 0G[-r,O], (a, Xg) H = J (a(9),X^(9)) Rd d9. 

In the equations above, V denotes the space of bounded, right continuous, iP-valued functions on 
[—r, 0], and F : [0, T] x R d x R x U —> R d is a given map, where U is a metric space in which the 
control u(-) takes values. For any initial state x € V and control u(-) € U[t,T] := {u : [£, T] —> 
U | u(-) is measurable}, the corresponding trajectory X(-) is a solution to (1.1). a and b are two 
given functions that satisfy suitable smoothness properties, and the coefficient F is assumed to 
satisfy a Lipschitz condition with respect to the appropriate norm. Thus, the solution to (1.1) is 
uniquely determined by the initial state and the control. 

*This work was partially supported by the National Natural Science Foundation of China (Grant No. 11401474), 
Shaanxi Natural Science Foundation (Grant No. 2014JQ1035) and the Fundamental Research Funds for the Central 
Universities (Grant No. 2452015087). 



The control problem consists of minimizing a cost functional of the following form: 



Jt 


( 1 . 2 ) 


over all of the controls u(-) £ U[t,T]. Here, q and cj> are functions on [0, T] x R d x U and R d , 
respectively. We define the value function of the optimal control problem as follows: 


V(t,x) := inf J(t,x,u), t£[0,T], x£V. 


ueU[t,T] 


(1.3) 


We assume that q and </> satisfy suitable conditions and consider the following Hamilton-Jacobi- 
Bellman (HJB) equations: 



where 



Here lo denotes the character function of {0}. The definition of a weak infinitesimal generator S 
will be given in section 3. 


The primary objective of this article is to develop the notion of a viscosity solution to the HJB 
equations given by (1.4). We then show the value function V defined in (1.3) is a unique viscosity 


solution to the HJB equations given in (1.4). 

The type of problem above arises in many different fields of application, including engineering, 
economics and biology. These problems typically disrupt the optimum operation of a system in 
the form of a time lag in the response to a given input. References 0 , 0 , a, and m present 
models with delays in economics; references [7] and |18| present deterministic advertising models 
with delay effects; references [5] and [6] present population models. 

These optimal control problems for differential equations with delays have been thoroughly 
investigated in recent years (see 0, 0, 0, ra, 0, m, uni, and However, to the best 

of our knowledge, none of these results are directly applicable to our case. In reference 0 and 
(19] . the optimal control problem was embedded in a Hilbert space, and the viscosity solutions for 
the associated HJB equations were investigated. These results do not hold when b {-) ^ 0 in the 
state equation. In 0 , 0 , m, and [18], the term b(-)X(■ — r) in the state equation is considered, 
the results obtained in these references only apply when the state equation is a linear differential 
equation with delays. Optimal control problems of a state equation with memory were investigated 
in 0 ; in these problems, however, the control must satisfy a linear condition, which is not fulfilled 
if F is a genuinely nonlinear function. 

It is well known that the optimal control problem given by (1.1) and (1.2) can be reformulated 
as an optimal control problem of the evolution equation in a Hilbert space (see, e.g. 0 and m)- 
However, in this case, the initial value must have the following form: = x £ H and X u (t ) = 

x° £ R d . This form ensures that the value function is not a viscosity solution of the associated 
HJB equations because of the b(-)X u (- — r) term in the state equations. To the aforementioned 
challenges, we study the associated HJB equations in an infinite dimensional space V. 

Crandall-Lions introduced the notion of viscosity solutions to the HJB equations in the early 
1980’s and showed that the dynamic programming method could be applied to optimal control 


problems. Since then, many papers have been published on the development of the theory of 
viscosity solutions (see, e.g., 0 , 0 , no, m , m, and tm References for dealing with equation 
in an infinite dimensional Hilbert space include m, na, nu, ns], nu , and |22j . In references 
HU, HU, HU, HU, and HU, Crandall and Lions systematically introduced the basic theories for 
viscosity solutions. Then, Zhou and Yong [22] proved the existence and uniqueness of a viscosity 
solution to general unbounded first-order HJB equations in infinite dimensional Hilbert spaces. 

To the best of our knowledge, the associated HJB equations (1.4) have not been previously 
studied. The primary difficulty in solving these equations is caused by the infinite-dimensionality 
of the space of variables and thus the non-compactness of the space. Hence,our problem does not 
fall into the framework used in references HZ], HU, HU, HU, HU, and [223. Thus, the standard 
proofs of the comparison theorem rely heavily on compactness arguments and are not applicable 
to our case. 

To overcome this difficulty, we first prove a left maximization principle for the space [0, T] x 
V x [0,T] x D ( see Lemma 4.1), i.e., variables exist that maximize functions defined. The proof 
of the comparison theorem involves maximizing the auxiliary function. The underlying principle is 
to use the left maximization principle to find a variable that maximizes the auxiliary function. 

We next introduce a slightly different notion of a viscosity solution to the HJB equations given 
in (1.4). We use the left maximization principle to prove the uniqueness of a viscosity solution that 
corresponds to our new definition og s viscosity solution. At the same time, we show that the value 
function is a viscosity solution to the HJB equations. 

Our results rely heavily on the construction of state equations. We hope to overcome this 
serious limitation of our approach in future work. However, our method is suitable for a large class 
of optimal control problems for differential equations with delays. 

The paper is organized as follows. In the following section, we define our notation and review 
the background for differential equations with delays are studied. In section 3 we prove the dynamic 
programming principle (DPP) and Lemma 3.5 which are used in the following sections. In section 
4, we define viscosity solutions and show that the value function V defined by (1.3) is a viscosity 
solution to the HJB equations given in (1.4). Finally, the uniqueness of viscosity solutions to (1.4) 
is proved in section 5. 

2 Preliminary work 

Here, we define the notations that are used in this paper. We use the symbol | ■ j to denote the norm 
in a Banach space F, the norm symbol is subscripted when necessary. For the vectors x, y € R d , 
the scalar product is denoted by (. x,y) R d and the Euclidean norm (x,x)^ d is denoted by \x\. For 
T > 0 and 0 < t < T, let C([t, T], R d ) denote the space of continuous functions from [t. T] to R d , 
which is associated with the usual norm \f\c = sup 0g [ t | f(0)\. Let r > 0 be fixed; then H denotes 
the real, separable Hilbert space L 2 ([—r, 0]; R d ) for scalar product (•,•)#. Let V denote the set of 
bounded, right continuous, R^-valued functions on [—r, 0]. We define a norm on T> as follows: 

\uj\v = sup |w(0)|, uj 
0e[— r,o] 

Then, (' D, | • \x>) is Banach space. 


We define the | • |#-norm on H as follows: 


where 


\x\% : = / ( Bx) 2 (s)ds, 


(Bx)(s) = / x(9)d9, s£ [-r, 0]. 


Let 0<t<t<T,0<s<s<T, and oo,oo,is,v £ V be given. We define (t,oo) <8> (t,oo) £ 
[0, T] x V and (t, oo , s, is) <g> (t, Co, s, is) £ [0, T] x V x [0, T] x V by 


where 


(t, lo) ® (t, w) := (t, Co), (t, oo, s, is) <8> (t, oo, s, is) := (t, Co, s, is), 
Co(9), t — t < 9 < 0, 


Co(9) = 

m = 


oo(t — t + 9), —r<9<t — t, 

9(0), t — t < 9 < 0, 


is(t — t + 9), —T<0<t — t. 

We denote the boundary of a given open subset Q C R d by dQ and Q = Q (J dQ. Let us define 

V Q := {co £ V : oo(9) £ Q, 0£ [-r,0]} 

and 

Vq := {oo £ P : w(0) £ Q, 0 £ [-r,0]}. 

Let us consider the controlled state equations: 


dX u (s) = F(s,X u (s),(a,X^) H ,u(s))ds + b(s)X u (s - r)ds, s£ 
= x £ D, 


( 2 . 1 ) 


where 


£ P, X s n (0) = X"(s + 0), 0 £ [—r, 0]. 

Here, the control u(-) belongs to 

U[t,T] := {u(-) : [t,T] —> U\ u(-) is measurable}, 
and where U is a metric space. We make the following assumptions. 

Hypothesis 2.1. (i) The mapping F: [0, T] x R d x R x U —> R d is measurable and a constant 

L > 0 exists such that, for every t, s £ [0, T], x, y £ R d x 12, u £ U, 

\F(t,x,u)\ < L(1 + \x\) and \F(t,x,u) — F(s,y,u)\ < L(\s — t\ + \x — y\). 

(ii) a(-) £ W 1,2 ([—r, 0]; with a(—r) = 0 and b(-) £ W 1,2 ([0, T]; R dxd ), and a constant L > 0 
exists such that, for every t,s £ [0,T], 


\b(s) — b(t )| < L|s — t|. 


A function X u : [t,T\ —>■ R d is a solution to equation (2.1) if the function satisfies the following 
condition: 

X“(s) = s(0)+ I* F(a,X u {a),(a,X%) H ,u(a))da+ f b(a)X u (a - r)da, s € [t,T], (2.2) 

Jt Jt 

where Xf = x € V,X u (s) = x(s — t), t — t < s < t. To emphasize the dependence of the solution 
on the initial data, we denote the solution by X u (s,t,x). 

Theorem 2.2. Let us assume that Hypothesis 2.1 holds. Then, a unique function X £ C([t,T]; R d ) 
exists that is a solution to (2.1). Moreover, 

sup \X u (s,t,x)\ < C\( 1 + |a;(0)| + sup 
se[t,T] V Ze[-r,0] 

where the constants C\ and C 2 depend only on L, T, t a(-) and b(-). 

Proof. For every initial value x £ T>, we define the mapping from C([t,T] \ R d ) to itself as 

4>(X“)(s) = x(0) + I* F(a,X u {a),(a,XZ) H ,u{a))da+ f b(a)X u {a - r)da, s e [t,T], 

Jt Jt 

where X u (s) = x(s — t) if s < t. We first show that 4>(X“) is continuous with respect to the time 
s. To this end, for every t < si < S 2 < T, there is a constant C > 0 that satisfies the following 
condition: 

|$(A“)( S1 )-$(A“)( S2 )[ < L [ S \l + \X u (a)\ + \(a,XZ) H \)da+ H \b(a)\\X u (a - r)\da 

Js 1 J Si 

< C( 1+ sup \x u ((j)\ + |x|x>)|s 2 — Sl|. 

cr(E.[t,T] 

We next show that it is a contraction, under an equivalent norm. We define the norm || X u || = 
sup s€ [j ^T] e ~ /3s \ -A“(s)|, where j3 > 0 will be chosen later. This norm is equivalent to the original 
norm on the space C([t, T]\ R d ). Then, the definition of the mapping yields 


/ 


x{d)dd 


+ \ x \b ) < C 2 (1 + |s(0)| + \x\ h), (2.3) 


$(A n ) ||= sup |e- /3s ^>(X“)(s)| 
se[t,T\ 


< |x(0)| + sup e-P s 

se[t,T] 


f \F(a,X u (a),(a,X2) H ,u(a))\da + 


b(a)X u (cr — r)da 


< |x(0)| + (T-f) 


1 


L + [ sup \b(s)\ + \b\ w i, 2 (T - t) 2 ] sup 
sG[0,T] Zg[-t,0] 


x{9)dd 


+ L\a\ w i ,2 \x \b 


+—(T + sup |6(s)| + \b\ w i. 2 {T — t )2 + 2Lr|a| w i,2) || X L 

P SG[0,T] 


(2.4) 


This result shows that <J> is a well-defined mapping on C([t, T]\R d ). If X u , Xf are functions 
belonging to this space, similar sequences of inequalities show that 

|| $(X n ) - 4>(A“) ||< i(L + sup |6(s)| + \b\ w i,2(T - t)5 + 2Lt\o\ w i,2) || X u - X J* || . (2.5) 

P sG[0,T] 


Therefore, for a sufficiently large /3 , the mapping is a contraction. In addition, (2.4) can be used 
to obtain (2.3). This result completes the proof. □ 


Remark 2.3. (i) The theorem above show that the solution X u (-) to equation (2.1) is continuous 

with respect to the time s £ [t, T] even if the initial value x belongs to T>. 












(ii) Theorem 2.2 also holds true when the initial state X “ = x E T> is replaced by X'f = x E H 
and X u (t) = x° E 

Let us now consider some continuities of the solution X u {-) to equation (2.1), these properties 
will be used in the proof of Theorem 3.2. 

Theorem 2.4. Let us assume that Hypothesis 2.1 holds. Then, constants C%,Ci > 0 exist that 
depend only on L, T, r a(-) and &(•), such that, for every t,t\,t 2 E [0,T], and x\,x 2 E D, 


sup sup \X u (s,ti,x 1 ) - X u (s,t 2 ,x 2 )| < C 3 ( 1 + |xi(0)| + |x 2 (0)|h + |xi| + \x 2 \h) 

ueU[tiM2,T] se[tiVt2,T] 

r0 


x ( |xi(0) - x 2 (0)| + |t 2 - ill 2 + sup 

le[-T, o] 


x\{6) — x 2 (0)d0 


sup sup \X u (s,t,xi) - X u (s,t, x 2 )\ < C4(|xi(0) - x 2 (0)| + \xi - x 2 \h). 

u£zL4[t,T] sGftjX 1 ] 


( 2 . 6 ) 

(2.7) 


Proof. For any t\,t 2 £ [0, T] and x\,x 2 € V, we assume that ii < t 2 < t\ + t. Let X u,l (s) 
denote X u (s,ti, xf) for s E [ti,T], where i = 1,2. Thus, we obtain the following results: 

sup |A’ u - 1 (a) -X“’ 2 (s)| 

S&[t 1 \/t2 ) l] 

< |xi(0) - x 2 (0)| + L[1 + (1 + \a\ H r) sup |X 1 ’“(s)| + \a\ H \xi\ H \(t 2 - h) 

sG[ti ,T] 


+ sup |6(s)| 
sE[0,T] 


/ 




x\{9)d9 


+ (1 + T 2 \a\ w i, 2 ) / sup \X u,1 (s) — X u,2 (s)\da 
Jt 2 se[l2,cr] 


f0 


+L\a\ w i, 2 Ti\T — t 2 \ sup 

le[-T+t 2 -t 1 ,o\ Ji 

+L\a\ w i, 2 T 2 \T — i 2 |(i 2 — ii) 5 [(i 2 — ii)2 sup |X“’ i (s)| + |® 2 

sG[ti,T] 
r0 


x\( 9 ) - x 2 {9 + t\— t 2 )d 9 

u.l 


+ sup |6(s)| / x\(9) - x 2 (9 + ti - t 2 )d9 

se[0,T] L Jt 2 —t\—T 

i r l 

+ (t 2 - ti )2 |x 2 | + / sup \X u,1 (s) - X u,2 (s)\da 

Jt2 s£[t2,cr] 


+ {t 2 -ti) sup |X u,1 (s) 

5G[il,T] 


Using the Gronwall-Bellman inequality, we obtain the following result, for a constant C > 0, 


sup -x u ’ 2 ( s )\ 

s6[tiVt 2 ,T] 

< C( 1 + |xi(0)| + |x 2 (0)| + \x\\h + |x 2 |h)(|xi( 0) - x 2 (0)| + \t 2 - ill + |i 2 - ii|^) 

i 

+2C\x\\\t 2 — ii |2 + C sup / x\(9) — x 2 {9)d9 . 

Zg[—T,0] Jl 


Applying the supremum i.e., sup uGW rj lAt2)T i, to both sides of the previous inequality, we obtain 
(2.6). We can show that (2.7) holds using a similar (even simpler) procedure. □ 


3 A DPP for optimal control problems 

In this section, we consider the controlled state equations: 

rs rs 

X u (s,t,x ) = x(0)+ / F(cr, X u (cr, £, x), (a, X™(t, x))h, u(a))da+ / b(a)X u (cr—T,t,x)dcr, sE [t, X 7 ], 

Jt Jt 

(3.1) 














(3.2) 


where X “ = x G D, and the cost function 

J(t, x,u) = J q(a, X u (cr, t, x),u(a))da + 4>(X U (T, t, x )). 

Our purpose is to minimize the function J over all controls u G U[t,T], We define the function 
V : [0, T] x V — » R by the following: 

V(t,x):= inf J(t,x,u). (3-3) 

ueU[t,T\ 

The function V is called the value function of optimal control problem (3.1) and (3.2). The goal 
of this paper is to characterize this value function. 

We make the following assumptions. 

Hypothesis 3.1. (i) The mappings q : [0,T] x R d x U —> R and (f> : R d —> R are measurable and 

there exists a constant L > 0 , such that, for every t G [0,T],x G R d ,u G U, 

\q(t,x,u)\ + \(f>(x)\ < L( 1 + |x|). 


(ii) There exist a constant L > 0 and a local modulus of continuously p such that, for every 
t, s £ [0 ,T],x, y, € R d , u € U, 

I q{t,x,u) - q{s,y,u)\ + \f{x) - f>(y)\ < L\x - y\ +p(|s - 1 1, |x| V |y|). 

Our hrst result is the local boundedness and two kinds of continuities of the value function. 

Theorem 3.2. Suppose that Hypothesis 2.1 and Hypothesis 3.1 hold true. Then, there exists a 
constant C§ > 0 such that, for every t,s £ [0,T], x,y G V, 

\V(t,x)\ < C 5 ( 1 + |x(0)| + \x\ H ), (3.4) 

I V(t,x) — V(t,y)\ < C 5 (|x(0) - 2/(0)| + \x - y\ H ), (3.5) 

and 


I V(t,x) -V(s,y) | < C 5 ( 1 + |x(0)| + \y{0)\ + \x\ H + \y\ h) 

x ( |x(0) — 2 /( 0 ) | + |s — t \ 2 + sup 
V Zg[ — T,0] 


x(9) — y{9)d6 


(3.6) 


Proof. We let 0 < t < s < T, x,y £ V, by Hypothesis 3.1 (ii), (2.3) and (2.6), for any 
u G U[t, T], we have 


I J(t,x,u) - J(s,y,u )| 

< (T + T)L sup [\X u (a,t,x) - X u (cr,s,y)\ +L f (1 + \X u (cr,t,x)\)do 

(re[s,T] Jt 

< L(1 + C*2(l + |x( 0 )| + |x|//))(s — f) + (T + 1)LC*3(1 + |a?( 0 ) | + |y( 0 )| + \x\ h + |y|//) 
x(0) — 2/(0) | + |s — 112 4- sup 

/e[-r,o] 

Thus, taking the inhmum in u G U[t,T], we obtain (3.6). By the similar procedure, we can show 
(3.4) and (3.5) hold true. The theorem is proved. □ 

We note that V(t, x) is not necessarily Lipschitz continuous in t. 

Secondly, we present the following result, which is called the dynamic programming principle 
(DPP). 







Theorem 3.3. Assume the Hypothesis 2.1 and Hypothesis 3.1 hold true. Then, for every (t,x) G 
[0, T) x V and s G [t,T], we have that 


V{t,x) 


inf [ q(a, X u (cr, t,x),u(a))da + V(s,Xf(t, x)) 
u&A[t,T\ YJt 


(3.7) 


Proof. First of all, for any u G U[s,T], s G [ t,T] and any u G U[t,s\, by putting them 
concatenatively, we get u G U[t,T}. Let us denote the right-hand side of (3.7) by V(t,x). By (3.3), 
we have 

V(t,x) < J(t,x,u) = j q(a, X u (a, t, x), u(a))da + J(s, Xf(t, x), u), u(-) G U[t, T]. 


Thus, taking the infumum over u(-) G U[s,T], we obtain 

V(t,x) < J q(a, X u (a, t,x),u(a))da + V(s,Xf(t, x)). 


Consequently, 


V (t, x) < V (t, x). 


On the other hand, for any e > 0, there exists a u £ G U[t,T], such that 


V(t,x)+e > J(t,x,u £ ) 

> ^ q(a,X u£ (cr,t,x),u £ (cr))da + J(s,Xf e (t,x),u e ) 

> J q(a,X ue (a,t,x),u £ (a))da + V(s, Xf e (t,x)) > V(t,x). 

Hence, (3.7) follows. □ 

Our next goal is to derive the so-called Hamilton — Jacobi — Bellman equation for the value 
function V. To begin with, let us introduce the operator S. For a Borel measurable function 
/ : T> —> R, we define 

s (f)i x )= l[n \r[f( x h)-f(x)}, xGV, 
h-+ 0 + h 

where x : [—r, T] —> R d is an extension of x defined by 


x(s), s G [—r, 0) 

x(0), s > 0 


and x s is defined by 

x s (9) = x{s + 9), 9g[—t, 0]. 

We denote by D(S) the domain of the operator S , be the set of / : V —> R such that the above 
limit exists for all x G T>. Define D(S ) as the set of all functions g : [0, T] x T> —» R such that 
g(t, ■) G D(S ) for all t G [0, T]. For simplicity, we define 


$ = {^GC 1 ([0,T]xV)nD(S)\3^ o GC 1 {[0,T]xR d xH), 
such that (p(t,x) = <po(t,x(0),x), V(t,x) G [0, T] x T>}. 


Theorem 3.4. Let V denote the value function defined by (3.3), if the function V(t,x) G <h. Then, 
V(t,x) satisfies the following HJB equation: 


■j%V(t,x)+S(V)(t,x) + H(t,x,V x V(t,x)) = 0, t £ [0,7], x G T>, 
V{T,x) = 4>{x{ 0)), 


(3.8) 




where 


H(t,x,p ) = inf [([F(f,x(0), (a,x) H ,u) + b(t)x(-T)]l 0 (t),p) + q(t, x(0),u)}, ( t,x,p ) G [0,T] x V x P* 

uGU 


Here the function lo : [—r, 0] R is the character function of { 0}. 

In order to prove this theorem we need the following lemma. 

Lemma 3.5. Suppose that Hypothesis 2.1 holds. If g E d>, then, for each (t,x) G [0, T) x V. the 
following convergence holds uniformly in u(-) G U\t,T\: 


lim 

£-> 0 + 


g(t + e,Xf +€ ) - g(t,x) 


~ 9 t(t,x) — S(g)(t, x) - (V x g(t,x),W(t,x,e)l 0 (t)) 


= 0, (3.9) 


where we let W(t,x,e) denote 7 // +c F(t, x(0), (a, x)h , u(a))dcr + b(t)x(— r). 

Proof. Since g G C 1 ([0,T] x P), by Taylor’s theorem we get that 

g(t + e,Xf +e ) - g(t,x) = g(t + e, Xf +e ) - g[t, Xf +e ) + g(t, x t+e ) - g(t, x) 

+{V x g(t,xt +e ),Xf +e -x t+ e)) + o{\Xf +e -x t+e \), iG[0,T-e], (3.10) 


Again by g G C 1 ([0,T] x V), we have that 

1 


lim sup 

<^ 0+ u(-)€U[t,T\ 

From g G D(S ), it follows that 


d 


e \g(t + e, Xf +e ) - g(t, Xf +e )] - —g(t, x) 


= 0 . 


(3.11) 


lim -(g(t,x t +e) - g(t,x)) = S(g)(t, x). (3.12) 

£->• 0 + e 

By the definitions of Xf and x s , we have that, for every e G [0, T — t], 

vu fas - fas _ j ft +e+e F ( a ’ XU ( cr )’( a i X a)H,u(a)) + b(a)X u (a - r)da, e + 6 > 0 , 
-A-t+esV) x t+e{?) — \ 

[0, e + 0 < 0. 

Thus, the following convergence holds uniformly in u(-) G U[t,T ]: 

lim e ^ 0 + i f t t+e F(a, X u (a),(a, Xf) H ,u(a)) 


lim l~(X t u +£ (t,x) -x t+e )](9) = < 
£—>- 0 + e 


0 , 


+ b(a)X u (a — r)da, 9 = 0, 

—t < 9 < 0. 


By (2.3), we get that, there exists a constant C > 0 independent of u(-) such that 


sup \[-(X? +e -x t+( 
0 e[-r,o] e 


< C. 


Thus, by the continuity of V x ogo(t, - ,x) and V x go(t,x° , •), we obtain 


lim sup 
<^ 0 + u {-)GU[t,T\ 


^ ^x9(fi x t+e)i x t+e) ^ ^xhifi x ) i -^t+e x t+e) 


< C lim \V x ogo(t,x(0),xt +e ) + V x go(t,x(0),xt + e) ~ S7 x og 0 (t,x(0),x) - V x g 0 (t,x(0),x)\ 
£->■ 0 + 

= 0 . 










Therefore, by the above inequality, we obtain that 


lim sup 

u (-)€W[t,T] 

= lim sup 

e^0+ u (-)£U[t,T] 


< lim sup 
£ -> 0+ u{-)£U[t,T\ 


-{V x g{t,x t+e ),Xt +e -x t+e ) - (V x g(t,x),W(t,x,e)l 0 (t)) 


(V x g(t,x),X? +€ -x t+e ) ~ {X x g(t,x),W(t,x,e)l 0 (t)) 


(V x go{t,x(0),x), -{Xt +£ -x t+ e)) 


+ lim sup 
<^0+ „(.) G U[t,T\ 


(Vx°go(t,x(o),x), 


- [ [F(a,X u (a),(a,X%) H ,u(a)) + b(e)X u (cr - T)]da -W(t,x,e)) 

e Jt 


= 0 . 


(3.13) 


Hence, dividing by e in (3.10) and sending e —»• 0 + , and putting together the results of (3.11), (3.12) 
and (3.13), we finally obtain (3.9). □ 

From the above lemma, the following two lemmas hold true, which will be used in the proof of 
uniqueness result for viscosity solution. 

Lemma 3.6. Suppose that Hypothesis 2.1 holds. Ifg(t,x) = go{t,\x\ 2 H ), (t,x) £ [0,T) x V, where 
go £ C' 1 ([0, T] x R ). Then the following holds: 

g(t + e , Xf+ e ) — g(t, x) , 2 \( 2/ \\ , 

---= gt{t, x) + g 0 {t, \x\ H ){x (0) - x (-r)) + o(l), (3.14) 

where o(l) is uniformly in u(-) £ U[t,T]. 


Proof. By Lemma 3.5, we only need to show that 

1 


lim sup 

„(.) G U[t,T] 

1 


[g(t + e, Xf +e ) - g(t , Xf +e )] - g t (t, x) 


= 0 , 


and 


lim - sup \V x g{t,x t + e ){Xf +e - x t+e )\ = 0, 

e ^ 0+ e u (.)g U [t,T] 


I™ -(g(t,x t+e ) ~ g(t,x )) = g' 0 (t, \x\ 2 h )(x 2 ( 0 ) -x 2 (-t)). 
e —e 


(3.15) 

(3.16) 

(3.17) 


By the similar procedure of Lemma 3.5, we get (3.15) and (3.16) hold true. Now, let us prove 
(3.17). From the definition of g, it follows that 


\g(t,x t +e) ~ g(t,x )) = \goft, \xt+e\ 2 H ) ~go{t, \x \ 2 h )) 

i 

2 , |2 i |2 \\/i-cr |2 f |2 


1 


e Jo 


g'oif, \ x \h + s (\ x t+e\H ~ — \ x \ h)J s 


= -f i x t+e( d ) -X 2 ( 0 )\d 6 f g' 0 (t,\x\ 2 H + s(\xt+e\ 2 H -\x\ 2 H ))ds 
6 J-T Jo 

= f^ 2 ( 0 )-- 


^ r~T+e \ />! 


X 2 { 0 )d 0 ) II g' 0 (t, \x\ 2 H + s{\x t +e\ 2 H - \ x ?H))ds. 


Letting e -> 0, we obtain (3.17). □ 


Lemma 3.7. Suppose that Hypothesis 2.1 holds. If ip(x) = ifo(\ x ~ °Ib) ,a,x£ V, where ifo £ 
C 1 (R). Then the following holds: 

~^{Xf +e ) - i/j(x) = 2^o(|(x - cl)\ 2 b )(B(x - a),x(0)l[_ r>0 ] - x) H + o(l), 

where o(l) is uniformly in u(-) £ U[t,T]. Here the function l[~ r ,o] ts the character function of 

[~T, 0 ]. 













Proof. By Lemma 3.5, we only need to show that 


and 


lim — sup \\7 x i/)(x t+e )(X? +e - x t+e )\ = 0, 
e^ 0 + e u (.) e u[t,T\ 


~H X )) = 2 V’o(I(®-“)II)( b (®-“)>®(0)1[-t,o] “*)h- 


(3.18) 


(3.19) 


By the similar procedure of Lemma 3.5, we can obtain (3.18). Now let us show (3.19) hold true. 
By the definition of ijj, we have that, for some s € (0,1), 

\^>{x t+e ) -1p(x)) = + s(x t +e - x))(x t+e - x)] 

2 

= -^' Q {\{x + s(x t+e - x) - a)\ 2 B )(B(x + s(x t+e -x) - a),B(x t+ e-x)). (3.20) 


On the other hand, we have that 


~{B(x - a),B(x t+e -x)) = - 

f 0 /-O 


r*0 r0 

—T J S 
■(s+e)A0 


(x(6) — a{9))d6 / (x t+e (9) — x(9))d9ds 


i rU rU / f(s+e )AU \ 

- j j (x(0) — a{9))d9 f — J x(9)d9 + ((— s) A e)x(0)J ds 

r0 rO 

/ (x(0) — x(s)) / (x(9) — a{9))d9ds = (B(x — a), x(0)l[_ Ti0 ] — x)h as e —>• 0, 


and 


1 If 0 

-(B((x t +e - x)),B(x t+ e - x)) = - / 

C €. J -r 


Xt+< 


:{9)-x(9)dd) ds 


\L 

o /-o 


"(s+e)A0 \ 2 

x{9)d9 + ((—s) A e)x(0) ) ds 


< 


e 2 ar( 0 ) + e 


"(s+elAO 


x 2 {9)d9 I ds —> 0 as e —> 0. 


Letting e —>• 0 in (3.20), we get (3.19). □ 

Remark 3.8. We note that D(S ) and D(S) are not empty. In fact, by (3.17) and (3.19), we 
have go(\x\ 2 H ), So(\ x ~ a \%) ^ B(S), if go € C 1 (R) and a € V. Moreover, go(\x\ 2 H ) + l(t) and 
go(\x — a\ 2 B ) + l{t) belong to D(S), if l £ C l {R). 

Proof of Theorem 3.4. First of all, by the definition of V, we have that V(T,x) = 0(x(O)). 
Next, we fix a u € U and x £ T>, from (3.7), it follows that 


0 <J q(a, X u (a, t, x), u)da + P(s, X^(t, x)) — V(t, x). 


By Lemma 3.5, the above inequality implies that 

^ „ 


0 < lim 


s— H+ S — t 

d_ 

m 


J q(a, X u (a,t,x),u)da + V(s,Xg(t,x)) — V(t,x) 


V(t,x) +S(V)(t,x) + ([F(t,x(0),(a,x)H,u) + b(t)x(-T)]lo(t),V x V(t,x)) + q(t, x(0), u). 


Thus, we have that 


(3.21) 





On the other hand, let x £ V be fixed. For any e > 0 and s > t, by (3.7), there exists a 
u = u £,s £ U[t, T] such that 

e(s — t ) > ^ q(a,X u (a,t,x),u(cr))d<j + V(s,Xg(t,x)) — V(t,x) 

= ^V(t,x)(s-t)+S(V)(t,x)(s-t) +J q(t,x(0),u(cr))da 

+{V x V{t,x), J [F(t,x(0),(a,x) H ,u(cr)) + b(t)x(-T)]dcrl 0 (t)) + o(|s — t|) 

> ^V(t,x)(s -t) + S(V)(t,x)(s - t) + H(t,x, V x V(t,x))(s -t) + o(|s - t\). 

Then, dividing through by s — t and letting s — t —> 0, we have that 

e > ^V(t,x) +S(V)(t,x) + H(t,x,V x V(t,x)). 

Combining with (3.21), we get the desired result. □ 


4 Viscosity solution of HJB equations: Existence theorem. 


In this section, we are going to introduce the notion of viscosity solution. M. G. Crandall and P. 
L. Lions M, m, im, na, m systematically introduced the basic theories of viscosity solutions 
for HJB equations in infinite dimensions. The proof of the uniqueness is mainly based on the weak 
compactness of separable Hilbert space (see also [22] J. We note that the HJB equation (3.8) is 
defined in T>, which doesn’t have the weak compactness. Thus, we need to give a new notion of 
viscosity solution of (3.8). To begin with, let us introduce the following key lemma that will be 
used in the proof of the uniqueness of viscosity solutions. 

Lemma 4.1. (Left maximization principle) Let Q be a bounded open subset of R d and let 
v : [0, T] x V x [0, T] x V —> R be continuous, and there exists an integer k > 0 such that, for every 
t,s e [o, T],x, xi,X 2 ,y, yi, 2/2 e V, 

\v(t,x,s,y)\ < L( 1 + \x\ H + |x(0)| + \y\ H + |y(0)|) fc , 

\v(t,x 1 ,s,yi)-\v{t,x 2 ,s,y 2 )\ < L(\xi -x 2 \h + |®i(0) -a; 2 (0)| + \yi - v 2 \h + |z/i(0) - 2/2(0)|) fc . (4.1) 

Then, for each (to, xq, sq, yo) £ [0, T] x Vq x [0, T] x Vq, there exists ( t,x,s,y ) £ [to,T] x Vq x 
[s 0 , T\ x Vq, such that (t, x, s, y) = (t 0 , x 0 , s 0 ,y 0 ) (8) (t, x, s, y), u(t, x, s, y) > u(t 0 ,x 0 , s 0 , y 0 ), and 

v(t,x,s,y)= sup v((t,x,s,y)®(t,x,s,y)). (4.2) 

( t,x,s,y)(E:[t,T ] xVq x [s,T]xT)q 

Proof. Without loss of generality, we can assume that v(to,xo, sq, yo) > v(to, xo+elo(-), so, 2 / 0 + 
l 1 q( 0 ) f° r e,l £ R d such that e + xo( 0 ),Z + yo( 0 ) £ Q ■ We set mo = v(to, xq, sq, yo) and 


m 0 := sup v((t 0 ,xo,so,yo)®(t,x,s,y))>m 0 . 

(t,x,s,y)e[to,T] xVq x [so,T] xX>q 


If mo = mo, then we can take ( t,x,s,y ) = (to, xq, so, Vo) and finish the procedure. Otherwise 
there exists (t 1 ,x 1 ,si,y 1 ) £ ( t 0 ,T ] xVqx (s 0 ,T] x Vq, such that (ti, ®i, si, yi) = (t 0 ,x 0 , s 0 ,yo) ® 


(ti,xi,si,yi) and 


m\ := v(ti,xi,si,yi) > 


m 0 + m 0 


9 



We set 


mi := sup v((t u xi,si,yi) <g> (t,x,s,y)) > m v 

( t,x,s,y)e[ti,T] xVq x [si,T] xVq 

If ffi\ = mi, then we can take ( t,x,s,y) = (ti,xi,si,yi) and finish the procedure. Otherwise we 
can find, for i = 2,3, • • •, (U, x u Si, yf) £ (U-i,T] x Vq x (sj_i,T] x Vq such that ( ti,Xi,Si,yi ) = 
(ti-i,Xi-i,Si-i,yi-i)®(ti,Xi,Si,yi), v(U, x h yf) > v(ti,Xi + el 0 (-),Si,yi + ll 0 (-)), for all e,l such 
that e + xi (0), l + yi (0) £ Q and 

:= u(t i: Xi, Si, yi) > ---, 

fhi := sup u((ti,Xi,Si,yi) <g> (t,x,s,y)) > m t , 

(t,x,s,y)e[ti,T]xT>Q [si,T]xT>Q 

and continue this procedure till the first time when fhi = mi and the finish the proof by setting 
(t, x, s, y) = (ti,Xi, Si,yi). For the last case in which fhi > mi for all i = 1,2, • • •, we have ti 1 1 G 
[0, T],Si | s G [0, T]. Then we can find Vq such that ( t,x,s,y ) = (ti,Xi, Si,yi) <S> ( t,x,s,y ). 

We can choose x(0), y(0) € Q such that u(t, x, s, y) > u(t, x + x\q{-), s,y + ylo(-)), for all x, y such 
that x + x(0),y + y(0 ) € Q. Since 

fhi + m,- fhi — mi 
m i+ 1 - m i+ 1 <mi ---=---, 

thus there exists fh € (mo, mo), such that fhi ^ fh and mi f m. By the definitions of x and y, we get 
Xi(s) —> x(s) and yi(s) —f y(s) for almost all s £ [—r, 0 ] and there exist two subsequences of a?j( 0 ) 
and yi( 0) still denoted by themselves such that Xi(0) —> a € Q and yi(0) —>b£Q, respectively. 
Thus, by (4.1) we get that 

fh = lim mi = lim v(ti,Xi, Si,yi) < v(t,x,s,y). 

z—>• oo i —^oo 

We can claim that (4.2) holds for this ( t,x,s,y). Indeed, otherwise there exist ( t,x,s,y ) £ (f, T] x 
Vq x (s, T] x Vq and 6 > 0 with (t, x, s, y) = (t, x, s, y) <S> (t, x, s, y), such that 

v((t, x, s, y) <S> (t, x, s, y)) > v(t, x,s,y) + 6 > fh + 5, 

then the following contradiction is induced: 

v{(t, x, s, y) ® (t, x, s, y)) = v((ti,Xi, s*, ® (t, x, s, y)) < fhi-f fh. 

The proof is completed. □ 

From the above lemma, we can now give the following definition of viscosity solution: 

Definition 4.2. w £ C([0,T] x V) is called a viscosity subsolution (supersolution) of (3.8) if the 
terminal condition w(T,x ) < <f>(x(0))(resp. w(T,x ) > (f>(x(0))) is satisfied and for every bounded 
open subset Q of R d and £ <h, whenever the function w — ip (resp. w + <p) satisfies 

(w - tp)(s, z ) = sup (vj - <p)((s, z ) (g> (t, x)), 

(t,x)e[s,T}xVQ 

( respectively, (w + ip)(s,z)= inf (w + <p)((s, z) ® (t, x))), 

(t,x)e[s,T]xT >q 

where (s,z) £ [0, T) x Vq and z(0) £ Q, we have 


<p t {s,z) +S(y)(s,z) + H(s,z,V x <p(s,z)) > 0, 





(■respectively , z) — S(ip)(s, z) + H(s, z, — V x ip(s, 2 )) < 0 ). 

w £ C([0,T] x V) is said to be a viscosity solution of (3.8) if it is both a viscosity subsolution and 
a viscosity supersolution. 

Remark 4.3. (i) A viscosity solution of the HJB equation (3.8) is a classical solution if it fur¬ 

thermore lies in 4>. 

(ii) In the classical uniqueness proof of viscosity solution to HJB equation in infinite dimensions, 

the weak compactness of separable Hilbert spaces is used ( see [22]). In our case, the HJB 
equation is defined on space V, which doesn’t have weak compactness. For the sake of the 
uniqueness proof, our new notion of viscosity solution is enhanced. At the same time, our 
modification doesn’t lead to additional difficulty in the existence proof. 

(iii) Assume that the coefficient F(t,x,y,u ) = F(t,x,u ), ( t,x,y,u ) £ [0, T] x R d x R x U and 
6 = 0. Let function V(t,x) : [0, T] x R d — > R be a viscosity solution to (3.8) as a functional 
V(t,x) : [0,T] xP— } R. Then V is also a classical viscosity solution as a function of time 
and state. 

We conclude this section with the existence result on viscosity solution. 

Theorem 4.4. Suppose that Hypothesis 2.1 and Hypothesis 3.1 hold true. Then the value function 
V(t,x) defined by (3.3) is a viscosity solution of (3.8). 

Proof. First, for every bounded open subset Q C R d we let ip £ 4* such that 

0 = (V - <p)(t,x) = sup (V - <p)((t,x) ® (s,y)), 

(s,y)€[t,T]xDQ 

where (t,x) £ [0, T) x Vq and x(0) £ Q. Then, for fixed u £ U and t < s < T, by the dynamic 
programming principle (Theorem 3.3), we get that, for s small enough, 

f*S FS 

tp(t, x) = V(t, x) < / q(a, X u (a),u)da + V(s, Xf) < / q(a, X u (a), u)da + ip(s, Xf). 

Jt Jt 

Thus, 

0 < ——— [ q{cr,X u (a),u)da + —^—[ip(s,X™) - <p(t,x)\. 
s — t J t s — t 

Now, applying Lemma 3.5, we show that 

0 < q(t, x(0),u) + tp t (t, x) +S(ip)(t, x) + (V x <p(t, x), [F(t, x(0), (a, x) H ,u) + b(t)x(-T)]l 0 (t)). 

Taking the minimum in u £ U, we get that V is a viscosity subsolution of (3.8). 

Next, for every bounded open subset Q C R d , we let ip £ such that 

0 = (V + ip)(t,x) = inf (V + ip)((t,x) (8) (s,y)), 

(s,y)e[t,T]xT> Q 

where (t,x) £ [0,T) x Vq and x(0) £ Q. For any e > 0 and s > t, by (3.7), one can find a control 
u £ (-) = u £ ’ s (-) £ U[t,T] such that, for s small enough, 




> 


J q{(T,X ue (cr),u £ {a))da - ip(s, Xf) + ip(t,x). 


Then, by Lemma 3.5, we obtain that 
1 rs 


£ > 


S — t 


J q{a,X ue (a),u e (cr))da - 


> -<p t (t,x) - S(<p)(t,x) + 


1 


ip{s ,X u£ ) - ip(t,x) 
s — t 

q(t,x(0),u E (cr)) 


s-tj t 

-(S/ X cp{t,x), [F(t,x( 0), ( a,x) H ,u e (a )) + b(t)x(-r)]l 0 (t))da + o(l) 

> -<p t (t,x) -S(ip)(t,x) + inf \q(t,x(0),u) 

ueu 

-(V x <p(t,x), [F(t,x( 0), (a, x) H , u) + 6(t)x(-r)]l 0 (t))] + o(l). 

Letting s ft and £->0we show that 

0 > x) - S{ip){t , x) + inf [q(t, x{0 ),u) - (V x <p(t, x), [F(t, x(0), (a, x) H ,u) + 6 (t)x(-r)]l 0 (t))]. 

ueu 

Therefore, V is also a viscosity supsolution of (3.8). This completes the proof of Theorem 4.4. □ 


5 Viscosity solution of HJB equations: Uniqueness theorem. 

This section is devoted to a proof of uniqueness of the viscosity solution to (3.8). This result, 
together with those in the previous section, will give a characterization for the value function of 
optimal control problem (3.1) and (3.2). 

We are now state the main result of this section. 

Theorem 5.1. Suppose that Hypothesis 2.1 and Hypothesis 3.1 hold true. Let W (resp. V) be a 
viscosity subsolution (resp. supsolution) of (3.8) and there exists a constant A > 0 such that, for 
(t,x), ( s,y ) € [0, T] x V, 


\W(t,x)\ V \V(t,x) | < A(1 + |x(0)| + |x| 


H 


(5.1) 


and 


I W(t,x) -W(s,y) | V | V(t,x) -V(s,y)\ < A(1 + |x(0)| + \x\ H + |y(0)| + \y\n) 

r 0 


x ( jac(0) — ?/(0) | T |s — t\ 2 + sup 

ze[-r,o] 


h 


x(0) — y(0)dd 


(5.2) 


Then W < V. 


From this theorem, the viscosity solution to HJB equation (3.8) can characterizes the value 
function V(t,x) of our optimal control problem (3.1) and (3.2) as following: 

Theorem 5.2. Let Hypothesis 2.1 and Hypothesis 3.1 hold true. Then the value function V defined 
by (3.3) is the unique viscosity solution of (3.8). 

Proof. By Theorem 4.4, we know that V is a viscosity solution of (3.8). Thus, our conclusion 
follows from Theorem 3.2 and Theorem 5.1. □ 

We are now in a position of showing the proof the Theorem 5.1. We first note that for 5 > 0, 
the function defined by W := W — | is a subsolution of 

f W(f, x) + S(W)(t, x ) + H{t, x, V x W(t, x)) = Jr, 

W(T,x) = <Kx(0)). 


t € [0, T], x ev, 







Since W < V follows from W < V in the limit 5 0, it suffices to prove the theorem under the 

additional assumption: 

d S 

—W(t,x)+S(W)(t,x) + H(t,x,V x W(t,x))>c, c:=j^, f G [0,T], x £ V. 

Proof of Theorem 5.1. The proof of this theorem is rather long. Thus, we split it into 
several steps. 

Step 1. Definition of auxiliary functions and sets. 

We only need to prove that W(t,x) < V(t,x) for all (t,x) £ [T — a,T) x D. Here 

1 T - 

« = A C = 1 + r\a\ w i ,2 + sup \b(s)\. 

8(1 + L) C l se[0,T] 


Then repeat the same procedure for cases [T — ia,T — (i — l)a). To this end we assume to the 
contrary that there exists (t,x) £ [T — a, T) x V, such that 2m := W(t,x) — V(t,x) > 0. Since 
Lipschitz continuous functions are dense in H, by (5.2) there exist a Lipschitz continuous function 
y and a £ R d such that W (t. x) — V(t, x) > rh, where x = y + dlo(-)- 
First, let e > 0 be a small number such that 

W(t,x) - V(t,x) -2e tiT ^ T \ \x\% + |x(0)| 2 ) > y, 

and 

9 L 2 e ^ C r>\ 

8fiT(l + L ) 2 “ 2’ ^ 5 ' 3 ^ 

where 

11 ~ 1 + 4T(1 + L) 2 C 2 ' 

Next, for every a > 0 we define for any ( t , x, s, y) £ [0, T] x V x [0, T] x V, 

O' 

V(t,x,s,y) = W{t,x) -V{s,y) - -d{t,s,x,y) 

pT (N H + l*(0)| 2 ) ~ pT + 

where 

d(t,x,s,y ) = |x(0) - y(0)| 2 + \x-y\ 2 B + \s - t\ 2 . 


Finally, for every M > 0 satisfying x £ 


r, we define 


M a := sup ^((f, x,t, x) <g> (t,x,s,y)), 


M a > M* := sup '&((t,x,t,x) <8> (t,x,t,x)) > —, 

t>t\x£D — tj- ^ 

- ’ q m 

where 

Q M ■■= {(x 1 ,X 2 ,.. .,x d )\ |xi| 2 + \x 2 \ 2 4-f \x d \ 2 < M 2 }. 

Step 2 . Properties of ^(t,x,s,y). 

By the definition of M a , we can fix (t, x), ( s,y ) £ [ t,T ] x 'D-qm satisfying 

(t, x, s, y) = (t, x, t, x) 0 (t, x, s, y), ^f(t, x, t, x) < \h(t, x, s, y) and ^(t,x,s,y) 4 —> M a . 








Now we can apply Lemma 4.1 to find (t,x),(s,y) € [T — a,T] x satisfying (t,x,s,y) = 

(t, x, s, y) ® (t, x, s, y) with ^(i, x, s, y) > x, s, y) > ^f(t, x, t, x) such that 


^(t,x,s,y) > '&((t,x,s,y) ® ( t,x,s,y )), t>t,s>s,x,y€ 


We should note that the point (t, x, s, y) depends on t, x, s, y, a, M. 

Step 3. For fixed M, there exists a subsequence of a still denoted by itself such that 


? d(t,x,s,y ) < - + | W(i,x) -W(s,y)\ + \V{t,x) -V(s,\ 
2 a 


0 as ot —^ +oo, 


and 


a\b(t)x(—T) — b(s)y(— r)| 2 —> 0 as a —> +oo. 
Let us show the above. We can check that 


(5.4) 

(5.5) 


a 


pT — t 


—d(t , x, s , y) + e- „ 
2 v pT 


(\x\ 2 h + | x ( 0 )| 2 ) + e 


pT — s 


pT 


I H 


+ 


< — + W(t, x) - V (s, y) - M a < — + W(t, x) - V(s, y) - M* 
a a 


1 


< —I - C — AT*, 
a 


(5.6) 


where C := 2A(1 + M + t^M). We also have that 


2M* < - + W(i, x) - W(s, y) + W(s, y) - F (S, y) + W(t, x) - C(f, x) + V{t, x) - F (S, y) 
a 


—ctd(i, x, s, y) — 2e 


I lT 1 f\*\2 , | A /nM2\ n-^ r - S , 


t-tT 


~(\%\h + l ^( O ) r ) — 2e - 




\ 2 h + 


< — + |bF(t,x) - W(s,y)| + |F(T,x) - F(s,y)| + 2M* - ad(t,x,s,y). 

a 


Thus 


w d(i,x,s,y ) < - + |VF(i,x) - VF(s,y)| + |F(i,£) - F(s,; 
z a 


(5.7) 


By the definition of d and (5.6), we get that |x—y |b —> 0 as a. —>• +oo. We note that |£]-pV|y|x> < M. 
Then, from the definition of B, it follows that there exists a subsequence of a still denoted by itself, 
such that 


sup 
ze[— t,o] 


J x(9) — y{O)d0 


0 as a —> +oo. 


Combining (5.2) and (5.7) we see that (5.4) holds. On the other hand, by x = y + dlo(-)j 0 < a < 
(t, x, s, y) = (t, x, s, y) ® ( t , x, s, y) and (t, x, s, y) = (t, x, t, x) ® (t, cc, s, y), we have that 


x{~r) = y(t- t -t), y(-T) = y(s-T-t). 

Since b and y are Lipschitz continuous, there exists a constant N > 0 such that 

a\b(t)x(—r) — b(s)y(— r)| 2 = a\b(i)y(t — t — i) — b(s)y(s — r — t)| 2 < Na\t — s| 2 . 


Then, (5.5) follows from (5.6). 

Step 4. There exist TV, M >0 such that f,s£ [t, T) and x(0), y(0) € for all a > N. 
First, we note that, for any a > 0, there exists a M > 0 be large enough such that 


'&(t,x,t,x) = W(t, x) — V(t, x) — 2e 


- */| ~|2 


uT 


(\x\ 2 H +\mn 









> W(t,x) -V(s,y) -e ^ T „ - M 2 - e ^ T — S M 2 


t-iT 


HT 


> V(t,x,s,y), 


where ( t,x,s,y ) e[0,T]xPx [0,T] x V and |x(0)| = |y(0)| = M. Therefore, for this M 
have that x(0),y(0) G Q M for every a > 0. 

Next, by (5.4), we can let N > 0 be a large number such that 

a „ 1 , 1 

-d(t,x,s,y) <- + \W(t,x) - W(s,y)\ + \V(t,x) -V(s,y)\ < -{rh Ac), 

2 a 4 

for all a > N. Moreover, we have t, s G [t, T) for all a > N. Indeed, if say s = T, then 
deduce the following contradiction: 

777/ 1 /v 

— < M* < M a < - + T(f, s, x, y) 

2 a 

< ~ + W(i, x) - W{s , y) + W (s, y) - V{s, y) 

a 

< - + \W(i,x)-W(i,y)\<T- 

a 4 

Step 5. Completion of the proof. 

From above all, for the fixed N, M > 0 in step 4, we find ( t,x),(s,y) G [t,T) x V^ 
fying x(0),y(0) G Q AI for all a > N and ( t,x,s,y ) = ( t,x,s,y ) ® (t,x,s,y) with T(f, x, 
T(t, x,s,y ) > T(t, x, t , x) such that 


T(t,x,s,y) > T((f,x,s,y) <g> (t,x,s,y)), t>t,s>s,x,y€ 'Dqm- 


Then 

T(t,x',.§,y) > ^((f,x) (8) (: t,x),s,y ), t > t,x G 
Thus, by the definition of the viscosity subsolution, we get that 

«(* - $) - + |x(0)| 2 ) + |(S(x - y),x(0)l[_ TiO ] - x) ff + g ^ r f: (|x(0)i 2 

+i^(f,x, [a(x(0) - j/(0)) + 2e M ^ T ^ (0)]lo(0) > c, 


x( 


Also, by (5.8), we have 


T(t,x,s,y) > T((t,x, (s,y) ® (s,y)), s > s,y G P^r- 

Thus, we obtain 

a(t-s) + ^(|y|/f + |£(0)| 2 ) - ^{B(y~x),y{ 0)l[_ r , O ] - J/)h - e^^(|y(0)| 2 - |y( 

uT — s 

+H(s,y, [-a{y{ 0) - x(0)) - 2e ^ y(0)]l o (t)) < 0. 

Combining (5.9) and (5.10), we obtain 

c + + l^(o)I 2 + \v\h + |y(o)l 2 ) +'l^( —r )l 2 + ~|y(~ r )l“ 

< |(P(x-y,x(0)l t _r,o] - x-y(0)l[_ T)O ] + £) + V (0)| 2 + ^ lT ~ |y(°)l 


> 0, we 

we will 

^ satis- 
s,y) > 

(5.8) 



-r)| 2 ) 

(5.10) 


2 












+H(t,x, [a(x(0) - y(0)) + 2e tJjT * £(0)]l 0 (t)) 

~H(s, y, [a(®(0) - y(0)) - 2e^-^y(0)]l 0 (t)). (5.11) 

On the other hand, by simple calculation we obtain 

H(t,x, [a(x(0) - y( 0)) + 2e^-^J-x(0)]l 0 (t)) - H(s,y, [a(x(0) - y( 0)) - 2e^^y(0)]l 0 (t)) 

< | sup(Ji + J 2 )|, (5.12) 

ueu 

where 

J\ = x(0), (a, x) H ,u) + b(t)x(-T),a(x( 0) - y( 0)) + 2e ^ T * x(0)) 

yT 

llT — s 

- (■ F(s , y{ 0), (a, y) H ,u) + b(s)y(-T),a(x( 0) - y( 0)) - 2e ^ y{ 0)) 

< aL(|x(0) - y(0)| 2 + |x(0) - y( 0 )\[\a\ w i, 2 |x - y\ B + \b(t)x(-T) - 6(s)y(-r)| + |i - s|]) 

+2 £L{ ^ T * )|x(0)|(l + sup |6(s)||i(-r)| + |x(0)| + \a\ w i, 2 \x\ B ) 

V 1 sG[0,T] 

+2sL ^ lT S )|t/(0)|(1 + sup |K s )l|y(-r)| + |y(0)| + \a\ w i,a\y\ B y, (5.13) 

sG[0,T] 


J 2 = q{t,x(0),u) - q(s,y(0),u) < L\x(0) - y(0)| + p(\t - s\,M). (5.14) 

Combining (5.11)-(5.14), we get 

c < \h + l^(0)| 2 + \V?H + |y(°)| 2 ) ~ £ ^ t \ x{-t)\ 2 - £ ^ t S \y(-T)\ 2 

+|(P - v)\ 2 b + r l £(°) - y( °) l ~) + g ^ T V (°) I 2 + £ ^ T ' s |£(°) l 2 

+aL(3|x(0) - y(0 )| 2 + |a|^i, 2 |x - y\ 2 B + | b(i)x(-r) - b(s)y(-r )| 2 + |t - s| 2 ) 

+ 2 eL( /iT t )|x( 0 )[(l + sup |6(s)||x(-r)| + |x( 0 )| + \a\ w i, 2 \x\ B ) 

V 1 se[o,T] 

+ 2 eL ^ T S )|y( 0 )[(I + sup |6(s)||y(-r)| + |y( 0 )| + \a\ w i, 2 \y\ B ) 

L 11 sg[o,t] 

+L\x(0) — 2 /( 0 ) | + p{\t — s\,M). 


Recalling a = 8 ( 1 + jq2 g 2 A y = 1 + iT ^ L y C 2 and t,s € [T — a, T), we show that 


c < 


< 


' - T 4 ‘°> )2 + (2(1 + L) ' 4 ' ~ 4(iTL) 14(0)1)2 + (4(0) 
-Whw{ (1 c^ - T^ (0))2 + (2(1 + - 4fTTL) l)i(0)l)2 + te(0) 

q T 2 ir 

+ 8/tT(l + L) 2 + “ (3L + T)(|£(0) “ ^ ( ° )|2 + - ^(- T )| 2 + I*- S l 2 ) 

+a(l + LC 2 )|x — + L\x(0) — y(0)| + p(\t — s|, M ) 

q r 2 _ 

8/tT(l + L) 2 + a ^ 3L + 1 (°) “ ^(°)| 2 + l 6 (^) f (“ r ) ^ Ks)y(-^)| 2 + 1 1 - s| 2 ) 

+a(l + LC~)\x — y\^ + L|£(0) — y(0)| + p(\t — s|, M ). 



























Letting a —>• +oo, it follows from (5.3) that 



which induces a contradiction. The proof is completed. □ 
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